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EXECUTIVE  SUMMARY 
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Problem  Scope 

This  is  a report  of  a study  conducted  by  Human  Sciences  Research  (HSR),  Inc.,  for 
the  Army  Research  Institute  (ARI),  entitled  Improved  A R TEP  Methods  for  Unit  Evaluation. 
under  Contract  DAHC  19-77-C-0001.  The  study  focuses  on  one  element  of  the  Army 
Training  and  Evaluation  Program  (ARTEP)-the  management  of  field  evaluations  of  tactical 
units  for  purposes  of  training  and  diagnosis  of  training  deficiencies.  Attention  is  directed  to 
the  planning  and  conduct  of  field  exercises  according  to  Training  and  Evaluation  (T&l  ) 
mission  outlines  provided  in  ARTEP  71-2,  for  training  of  Tank/  Mechanized  Infantry  battalions. 

ARTEP  T&E  Outlines;  Research  Requirements 

The  TRADOC-sponsored  Army  Training  and  Evaluation  Program  consists  of  concepts, 
guidance  and  training  materials  which  together  embrace  all  Army  training.  Guidance  and 
training  materials  are  stiil  being  produced,  refined  and  dispatched  to  field  users.  Elements 
of  concent  to  this  study  ( mission  T&E  outlines)  replace  the  Army  T raining  1 ests  ( A 1 Is) 
which,  since  World  War  II,  provided  the  basic  mission  format  for  unit  field  training.  The 
current  ARTEP  T&E  outlines  are  performance  oriented.  They  are  designed  to  provide 
settings  which  more  realistically  represent  realities  of  the  modern  battlefield,  and  changes 
in  tactics  required  to  accommodate  new  weaponry  and  supporting  military  hardware. 

The  transition  to  ARTEP  is  still  in  progress.  Transitions  from  one  system  and  set  of 
concepts  to  another  is  never  easy. 1 This  study  seeks  to  provide  guidance  and  training 
materials  that  would  assist  in  the  transition,  helping  to  assure  that  the  concepts  upon 
which  ARTEP  is  based  are  wisely  and  imaginatively  applied  in  unit  field  training. 

Research  Methodology;  Problem  Areas 

The  research  approach  selected  is  an  iterative  case  study  method.  The  cases  consist  of 
observations  of  the  conduct  of  field  evaluations  from  battalions  of  three  divisions,  and  dis- 
cussions with  the  key  planner/supervisor  of  unit  training  in  a fourth  division.  Information 
and  data  served  to  document  current  practices  and  user  problem-solving  efforts  under  the  new 
ARTEP  system.  Comparison  of  data  across  cases  permitted  identification  of  recurrent  problems. 

Examples  of  problems  and  areas  where  guidance  is  needed  arc; 

• Difficulties  in  interpreting  and  applying  basic  ARTEP  system  principles 
to  unit  training  and  evaluation  programs. 

’Major  General  John  W.  Scigle.  “The  Army  Training  System:  A Status  Report,"  IX'ST.  HQ.  TRAfXX'. 
AUSA  Convention.  October  1977. 
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• Uncertainties  in  developing  the  1 valuation  Plan  particularly  such  aspects  as 
exercise  format,  scenario  construction,  and  technical  simulation/control 
measures. 

• Problems  in  interpreting  and  using  the  T&F  outlines,  and  in  organizing 
and  training  the  Evaluator/Controller  Group. 

• Limited  effectiveness  in  formulating,  communicating,  and  using  ARTEP 
evaluation  results  for  remedial  training. 

Along  with  observation  of  cases,  we  interviewed  cognizant  officers  at  TRADOC/FORSCOM. 
schools  and  operational  divisions.  Two  symposia  on  ARTEP  were  attended.  C oncepts  and 
methods  from  the  scientific  literature  (learning  theory,  systems  analysis,  psychometric  methods, 
etc.)  were  reviewed  to  determine  whether  they  might  shed  light  on  problems  encountered, 
and  for  their  contributions  to  solutions.  Together,  the  scientific  literature  and  military 
sources  suggested  directions  for  recommended  solutions. 

Problem  Remedies 

Remedial  efforts  took  two  forms.  The  first  is  a body  of  short-term  guidance  which  is 
incorporated  in  the  Field  Guide.  The  second  is  identification  of  a range  of  issues  wherein 
further  ARTEP  developmental  research  is  still  needed. 

The  Field  Guide  Proposed  solutions  based  on  work  described  above  are.  of  course, 
tentative.  The  Field  Guide  renresents  a first  attempt  to  organize,  and  to  incorporate  proposed 
solutions  into  a practical  document  that  officers  who  plan  and  implement  battalion  field 
evaluations  will  find  useful.  It  includes: 

« Procedures  for  the  application  of  core  ARTEP  principles  to  decisions  such  as 
when  to  conduct  external  evaluations,  how  to  task  key  personnel,  how  many 
assets  to  commit,  and  how  to  insure  a “diagnostic”  orientation. 

• Guidelines  for  overcoming  deficiencies  in  the  most  essential  steps  of  preparing 
the  Evaluation  Plan  and  implementing  it. 

• An  Evaluator/Controller  Group  module  including  a complete  curriculum  for 
training,  and  guidance  for  interpretation  and  use  of  the  T&l  outlines. 

« Procedural  improvements  for  the  use  of  evaluation  results. 

Follow-on  research  and  development.  Follow-on  research  and  development  will  under- 
take four  tasks: 


• Validate  and  refine  the  first  generation  Field  Guide  by  field  testing.  This 
includes  a number  of  subtasks.  Among  these  are: 

Development  of  instructions  for  evaluators  as  they  rate  performance 
on  those  items  (standards)  that  require  professional  judgment. 

Evaluation  of  revised  formatting  of  standards,  and  their  phrasing. 

Evaluation  of  alternative  means  of  combining  item  scores  to  validly 
reflect  unit  performance. 

• Identify  and  evaluate  alternative  means  by  which  battalion  evaluations  can  be 
integrated  info  a program  involving  concurrent  multi-echelon  training. 

» Determine  how  ratings  obtained  during  battalion  evaluations  can  best  be 
utilized  in  remedial  training. 

• Update  the  analytic  document  (Volume  II,  this  study)  based  on  all  work 
performed  above. 

Organization  of  this  Report 

This  Final  Report  is  presented  in  three  volumes.  These  are: 

Volume  l — Executive  Summary;  Study  Design  and  Field  Research  describing 
project  objectives,  procedures  and  field  data. 

Volume  II  Analysis  - describing  analytical  steps  to  problem  remedies. 

Volume  III  The  Field  Guide  for  Evaluation  Procedures  presenting  the  first 
generation  Field  Guide  in  a three-module  format. 


PART  ONE:  STUDY  DESIGN 
AND  FIELD  RESEARCH 


CHAPTER  I 


INTRODUCTION 


1-1.  PROJECT  OVERVIEW 

This  is  a report  of  the  first  phase  of  a two-phase  research  project  conducted  by  HSR  for 
the  Army  Research  Institute  ( AR1).  Its  objectives  are  to  identify  problems  in  the  conduct  of 
Army  Training  and  Evaluation  Programs  ( ARTEP)  for  field  units,  to  develop  remedies,  and  to 
incorporate  these  into  a practical  Field  Guide  to  be  used  in  conjunction  with  battalion  field 
evaluations.  Work  is  presented  in  three  reports  (Volumes  I,  II,  III)  of  which  this  is  the  first. 

Phase  11  research  will  extend  the  analysis  of  problems  and  recommended  solutions,  refine 
the  Phase  I Field  Guide,  and  examine  means  of  integrating  battalion  field  exercises  and  resulting 
measures  of  performance  into  other  training  by  operational  units. 

a.  Task  organization.  The  Phase  I work  performed  is  structured  in  three  tasks,  as 
follows: 

( 1 ) Task  1.  Documents  and  collates  current  practices  in  ART  IP  exercises. 

It  accumulates  the  field  experiences,  the  problems  encountered  and  the 
solutions  generated  as  a result  of  efforts  to  use  the  new  ARTEP  system 
and  its  external  evaluation  component  by  Tank/Mechanized  Infantry 
units  over  the  past  several  years. 

(2)  Task  2.  Analyzes  these  data  from  the  perspective  of  the  problems  they 
present  for  evaluating  performance  within  the  ARTEP  framework.  Task  2 
also  identifies  possible  solutions  to  these  problems  and  recommends  remedies. 

(3)  Task  3.  Organizes  these  remedies  into  a Field  Guide.  The  Field  Guide  is  to  be 
used  by  unit  commanders,  planners,  trainers,  and  evaluators  in  conjunction 
with  ARTEP  71-2  to  better. prepare  and  conduct  evaluation  exercises.  Results 
desired  are  improvements  in  the  conduct  of  training,  and  an  enhanced  ability  to 
diagnose  leader  and  unit  deficiencies. 

b.  Reports  and  summaries.  Project  reports  are  presented  in  three  volumes. 

(I)  Volume  I Executive  Summary:  Study  Design  and  Field  Research.  This  volume 

presents. 

• Executive  Summary. 

• Study  objectives,  and  research  approach 


• Field  research  procedures  used  to  collect  information  and  establish  a data  base. 

: 


• Issues,  problems  and  deficiencies  in  current  practices  of  battalion 
field  evaluations. 

(2)  Volume  II.  Analysis.  Volume  II  describes  the  analysis  performed  in  I ask  2. 
This  analysis  is  organized  under  three  major  headings. 

• ARTEP  system  concepts  and  applications  to  Evaluation  Plan 
design. 

9 Evaluation  methodology. 

» Use  of  evaluation  results. 

In  each  area,  the  analysis  revealed  that  many  problems  involved  in  ARTEP 
implementation  cannot  be  solved  quickly  or  simply.  As  a result,  each  topical 
section  separates  these  from  problems  for  which  immediate  help  could  be 
found.  Recommendations  for  how  to  deal  with  the  more  difficult  problems 
are  then  presented.  These  recommendations  and  a summary  of  major  results 
are  reviewed  in  a concluding  chapter  of  this  volume. 

(3)  Volume  III.  Field  Guide.  The  Field  Guide  is  designed  to  address  current 
problems  described  in  Volume  I.  It  incorporates  proposed  solutions  to  these 
problems  developed  in  Volume  II.  It  is  a prescriptive  document  intended  for 
unit  planners,  training  managers  and  evaluators.  It  is  organized  so  as  to  be 
used  as  a text  by  planners,  instructors  and  by  controller  evaluator  trainees. 

While  prescriptive  in  tone,  this  is  a first  generation  document.  It  would  be  unrealistic  to 
believe,  or  to  hope,  that  all  solutions  recommended  are  workable,  or  that  all  materials  are  pre- 
cisely on  target.  In  the  Phase  II  follow-on  study,  it  would  be  tested  in  the  field.  This  test  will 
undoubtedly  lead  to  additions,  modifications  and  deletions.  These  will  be  incorporated  in  a re- 
vised version. 

1-2.  PROJECT  BACKGROUND  AND  MAJOR  ISSUES 

a.  ARTEP.  The  Army  Training  and  Evaluation  Program  (ARTEP)  has  been  designated 
by  the  US.  Army  to  replace  the  Army  Training  Test  (ATT)  and  the  Army  Training  Program 
(AfPi  as  the  primary  training  instrument  for  battalion  and  subordinate  level  units.  The  pur- 
poses of  ARTEPs  are: 

( I ) To  evaluate  the  ability  of  a tactical  unit  to  perform  specified  missions 
under  simulated  combat  conditions. 

(2)  To  provide  a guide  for  training  by  specifying  mission  standards  or 
performance  for  combat-critical  missions  and  tasks. 
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(3)  To  evaluate  the  effectiveness  of  past  trawling  of  ah  echelons  from 
crew/squad  through  battalion/task  force. 

(4)  To  provide  an  assessment  of  future  training  needs. 

b.  ARTEP  compared  with  ATTs.  Some  comparisons  between  A I'Ts  and  the 
ARTEP  T&E  mission  outlines  which  replaced  them  may  be  ol  interest. 

( 1 ) ATTs  were  training  tests:  AR  H;Ps.  by  contrast,  emphasize  training 
and  training  diagnosis  of  deficiencies. 

(2)  While  the  difference  is  one  of  degree.  Alls  gave  greater  emphasis 
to  mission  planning.  ARTEPs  to  performance. 

(3)  ATTs  tended  to  be  conducted  as  field  drills,  often  well  rehearsed 

in  advance.  ARTEPs.  on  the  other  hand,  allow  for  logical  branchings 
of  activities  within  missions.  Planners  are  encouraged  to  include 
surprises  and  occasions  for  innovative  problem  solving. 

(4)  It  was  felt  that  ATT  checklists  were  over-developed  and  put  too 
much  emphasis  on  performance  by  lower  echelons.  Rating  formats 
used  by  ARTEP  are  less  well  articulated,  and  place  greater  emphasis 
on  command  performance. 

(5)  Finally,  ARTEPs  are  designed  to  reflect  modifications  in  tactics  that 
have  occurred  in  the  last  quarter  century. 

ARTEP  statements  of  performance  criteria  are  a significant  improvement  over  ATTs.  How- 
ever, it  has  not  yet  been  demonstrated  that  ARTFP  l&E  outlines  are  stated  with  optimal 
completeness,  specificity,  and  detail.  TRA1X3C  has  been  extending  the  guidance  provided  in 
the  first  five  chapters  of  ARTEP  volumes.  However,  to  our  knowledge,  guidance  has  not  been 
systematically  checked  for  its  value  to  planners.  In  ground  tactics,  the  validity  of  evaluations 
must  depend  largely  on  professional  judgments  of  evaluators.  Thus,  while  the  AR  I EP  approach 
is  believed  much  superior  to  the  ATTs,  its  objectives  can  still  be  compromised  by  poor  field 
administration.  The  goals  of  this  research  are  to  help  assure  that  ARTEPs,  as  practiced  in  the 
field,  fully  exploit  their  inherent  training  potential. 

c.  Needs  for  research;  focus  of  efforts.  Field  observations  and  interviews  conducted  early 
in  Task  I served  to  help  direct  and  sharpen  the  focus  of  research.  These  observations  point  to 
three  needs  which  research  must  address. 
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( 1 ) Unit  needs  for  further  guidance.  Field  experience  with  conducting 
formal  ARTEP  71-2  evaluations  quickly  led  to  a number  of  problems  of  different  types. 

The  occurrence  of  these  problems  has  often  led  to  imaginative  efforts  by  senior  commanders, 
training  managers,  and  evaluators  to  deal  with  difficulties  as  they  arose.  Problems  have  also 
stimulated  interest  in  being  supplied  sound  guidance  for  improving  ARTEP  evaluation  procedures. 

(2)  Need  to  broaden  study  scope.  The  central  objective  of  this  study  . as  stated 
initially,  was  to  refine  evaluation  instruments  (i.e.,  T&E  mission  outlines)  and  procedures  for 
their  use.  Discussions  with  cognizant  officers  and  field  observations  quickly  led  to  a broader 
and  far  more  diverse  set  of  concerns.  These  were  reviewed  with  the  ARI  Project  Monitor, 
who  accompanied  the  team  on  field  visits  and  took  part  in  interviews.  It  came  to  be  realized 
that  problems  of  improving  the  technical  quality  of  instruments  are  deeply  interwoven  with 
many  surrounding  issues  and  problems.  These  had  to  do  with  organizing,  tactically  structuring, 
controlling  and  supporting  the  large-scale  field  exercises  which  serve  as  the  evaluation  vehicle. 
Problems  also  emerged  in  integration  of  ratings,  and  use  of  results  to  provide  feedback.  Ihus. 
working  solutions  to  (or  at  least  a better  understanding  of)  such  issues  were  prerequisite  to 
evolving  solutions  to  a number  of  technical  problems. 

Accordingly,  the  scope  of  inquiry  was  broadened.  Clearly,  larger  issues  having  to  do  with 
management  of  the  evaluation  vehicle,  and  interrelationships  between  them;  and  between  manage- 
ment issues  and  technical  problems  needed  to  be  better  understood.  Given  this  understanding, 
it  should  lx*  possible  to  better  understand  the  conditions  under  which  evaluation  instruments 
are  to  be  applied. 

(3)  Need  for  practical  guidance.  The  target  audiences  of  the  Field  Guide  are 
planners,  training  managers  and  evaluators.  Guidance  must  recognize  constraints  that  are 
virtually  universal  in  the  field.  Among  these  are  limitations  in  collective  training  time,  per- 
sonnel of  the  necessary  ranks  to  serve  as  evaluators,  logistics,  pyrotechnics,  etc.,  etc.  further, 
while  scientific  constructs  may  be  found  useful,  their  applications  cannot  presume  education 
training  in  areas  from  which  they  are  drawn.  Guidance  must  lx-  set  forth  in  terms  familiar  t<> 
users.  The  organization  and  the  sequence  of  activities  called  for  must  be  compatible  with  those 
to  which  users  are  accustomed. 

1-3.  SUMMARY 

This  chapter  describes  the  study  objectives,  tasks  and  the  organization  of  the  report.  Back- 
ground information  on  ARTEPs  was  summarized.  We  have  indicated  how  early  field  visits  sharpened 
the  focus  of  the  study.  The  next  chapter  explains  research  methodology  < hapter  3 presents 
and  discusses  field  observations.  The  analysis  of  these  observations  is  presented  in  \ olumc  II 
the  Field  Guide  is  bound  as  Volume  III. 


5 


CHAPTER  2 


RESEARCH  RATIONALE  AND  APPROACH 


2-1.  INTRODUCTION 

This  chapter  describes  the  project  objectives  and  shows  how  these  objectives  and 
"givens"  required  in  the  study  gave  rise  to  the  research  approach  an  iterative  case  study 
method-  and  to  research  procedures.  It  then  identifies  sources  of  information  and  describes 
how  information  was  integrated  to  produce  the  research  products.  The  sources  of  informa- 
tion included  observations  of  battalion  field  exercises,  site  visits,  symposia,  and  military  and 
scientific  publications.  These  are  documented  in  Attachment  A. 

The  AR  I EP  system  is  in  the  early  stages  of  its  development.  It  was  rapidly  pro- 
duced and  dispatched  promptly  to  field  units.  Some  of  the  mission  T&E  outlines  are  still 
being  refined.  It  has  not  been  fully  tested  or  evaluated.  Decisions  as  to  how  best  to 
implement  the  key  concepts  of  decentralization,  and  of  tailoring  training  to  local  mission 
needs  often  rest  on  rather  broad  guidance  from  I RA  DOC  and  proponent  schools.  Decentral- 
ization of  authority  has  triggered  a high  degree  of  local  initiative,  as  well  as  issues  as  to 
specific  procedures  for  its  implementation.  H is  well-recognized  that  substantial  problems 
remain  in  implementation;  indeed,  it  would  be  surprising  if  they  did  not. ' 

The  objectives  of  this  study  stem  from  this  context.  An  obvious  requirement 
is  to  examine  current  practices  in  the  implementation  of  ARTEPs  in  the  field.  It  was 
necessary  to  determine  what  is  being  done  by  operational  units  to  implement  ARTEP,  what 
types  of  problems  they  are  encountering,  and  what  directions  might  be  pursued  in  problem 
resolution. 

Since  ARTEPs  are  very  broad  and  all-encompassing,  this  initial  effort  was  exploratory. 
Early  inquiries  suggested  that  no  demonstrably  valid  data  base  was  available,  nor  was  it  immedi- 
ately apparent  what  such  a ilata  base  should  consist  of.-  The  topical  areas  for  data  collection 
had  to  be  identified,  and  the  interrelationships  between  them  determined.  This  required,  in 
turn,  a conceptual  framework  which  would  guide  the  collection  of  information  and  the  assign- 
ment of  items  to  defined  categories.  It  was  also  necessary  to  develop  concepts  as  to  which 
categories  of  information  were  interrelated,  and  in  what  manner. 


' Major  General  John  W Seigle,  "The  Army  Training  System:  A Staius  Report.”  DCST,  HO, 
TRADOC,  AUSA  Convention.  Oeloher  l‘)77. 

-Having  completed  the  first  year  of  study,  we  Icel  much  better  able  to  specify  requirements  for  a 
data  base. 
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This  assessment  gave  rise  to  two  concurrent  efforts:  ( I)  collection  of  information  hy 
observation  of  field  exercises  conducted  by  selected  units,  and  (2)  developing  a conceptual 
model  to  structure  the  information  and  problem  areas.  Both  efforts  contributed  to  the  end 
product  a Field  Guide  for  the  conduct  of  battalion-level  external  evaluations. 

2-2.  RESEARCH  OBJECTIVES,  REQUIREMENTS 

The  requirements  of  the  study  and  the  problems  of  field  implementation  of  ARTEP 
help  to  further  focus  efforts: 

a.  Selection  of  unit.  Project  emphasis  is  on  the  operations  of  tank/mechanized 
infantry  task  forces.  The  lowest  level  at  which  armor,  infantry  and  anti-armor  are  ordinarily 
brought  together  as  coordinated  maneuver  elements  is  at  battalion  level.  Field  observations 
were  then  to  concentrate  on  the  broad  level  management  of  battalion  field  evaluation  exer- 
cises, particularly: 

(1)  Policies  bearing  on  the  conduct  of  field  evaluations. 

( 2)  Evaluation  planning. 

(3)  Field  implementation  of  evaluations  by  evaluator/controller 
(E/C)  groups. 

(4)  Use  of  results. 

Thus,  the  tactical  unit  selected  is  the  tank/mechanizcd  infantry  task  force;  the 
study  focuses  on  operations  of  the  evaluator/controller  team  in  conducting  field  evaluations 
for  this  task  force. 

b.  Evaluation  emphasis.  Consistent  with  stated  ARTEP  objectives,  emphasis  is 
placed  on  the  use  of  field  evaluations  for  training  and  diagnostic  purposes  rather  than  as 
measures  of  accountability  or  of  operational  readiness.  (It  appears  likely  that  steps  required 
to  plan  and  conduct  field  evaluations  are  similar,  whether  the  exercise  purpose  is  training 
or  to  measure  accountability.  Uses  to  be  made  of  results  differ,  however.) 

c.  Requirements  for  model.  The  generic  requirements  for  the  conceptual  structure 
are  as  follows: 

( 1)  The  model  should  identify  the  key  variables  in  the  area  of  study.  Items  a., 
and  b.,  above  introduce  a number  of  these  variables.  Other  variables  can  be 
inferred  from  these. 
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(3)  Causal  relationships  are  assumed  among  certain  variables  in  the  model. 

It  should  be  possible  to  verify  these  assumed  relationships.  More 
specifically,  within  the  context  of  management  of  field  evaluations,  it 
should  be  possible  to  relate  variables  within  the  areas  of  policies, 
planning,  execution  of  field  evaluations  and  use  of  results.  If  this  can 
be  done,  we  will  have  provided  TRADOC/FORSCOM  and  division  and 
brigade  planners  with  the  evaluation  tools  needed.  These  can  be  used 
to: 

(a)  diagnose  deficiencies  in  current  practices,  and 

(b)  change  policies  and  implement  management  procedures  so  as 
to  improve  the  management  of  battalion-level  field  evaluations. 

Note  that  all  policies  and  measures  taken  focus  finally  on  the  operations 
of  the  F.valuation/Controller  Group  or  team. 

The  variables  and  relationships  emerged  as  field  evaluation  exercises  were  examined 
and  the  literature  was  reviewed.  Here,  the  emerging  model  helped  to  ask  questions,  and 
to  assign  answers  to  variable  categories.  This  process  characterized  the  research  approach 
and  methodology  described  below. 

2-3.  RESEARCH  APPROACH;  METHODOLOGY 

The  research  approach  and  methodology  were  derived  from  the  study  objectives  and  require- 
ments just  discussed.  This  is  an  iterative  case  study  method.  Cases  consisted  of  observations  of 
battalion  field  evaualtion  exercises.  On  three  occasions  (Cases  1. 3.  and  4)  battalions  operating 
as  integral  units  were  closely  observed.  Each  consisted  of  observations  of  two  battalions.  To 
these  were  added  reconstructions  of  methods  by  which  other  battalion  field  evaluations  had 
been  conducted  from  interviews  with  training  managers  (Case  2),  and  observations  of  company 
level  field  evaluations.  A number  of  other  sources,  military  and  scientific,  were  woven  around 
these  cases.  Figure  1 provides  a schematic  showing  how  all  sources  were  drawn  together  to  yield 
the  research  products. 

The  observations  of  battalions  engaged  in  ARTEP  external  evaluations  provided  the  basic- 
data  for  this  study.  Observations  started  in  December  1976  and  continued  until  evaluations  for 
six  battalions  and  subordinate  units  had  been  observed.  Data  was  collected  on  three  additional 
battalions  solely  by  interviews  rather  than  observations.  During  these  site  visits,  officers  who 
planned  and  managed  the  evaluations  were  interviewed,  and  post-exercise  critiques  were  attended. 
Where  tcasible.  follow-up  interviews  were  conducted  with  the  managers  and  evaluators  of  the 
tield  exercises.  The  battalions  observed  were  drawn  from  four  separate  divisions,  two  infantry 
and  two  armor.  We  thank  these  officers  for  their  help  and  cooperation. 


8 


a.  Case  observations.  Research  procedures  and  lines  of  inquiry  were  developed  as  evalua- 
tions were  observed.  This  is  illustrated  by  recounting,  as  examples,  a few  themes  as  they  emerged 
f igure  2-1  shows  how  information  front  cases  and  other  sources  was  combined.  Divisions  studied 
are  designated  as  Divisions  A.  B.  C and  D. 

Il)  Case  1.  larly  observations  of  the  first  case  Division  A provided  insights  into 
field  practices  in  planning  for  anil  conduct  of  evaluations.  We  had  to  assume  these  practices  to 
be  usual,  since  we  had  no  firm  basis  for  comparison  at  the  time.  For  example,  il  became  evident 
very  early  that  use  of  evaluation  instruments  (T&I  mission  outlines)  could  be  improved  through 
better  evaluator  training.  But  it  was  also  evident  that  this  problem  was  interrelated  with  several 
others.  One  was  that  of  controlling  OPFOR  so  that  all  unit  behaviors  described  in  the  T&l  out- 
lines would  have  occasion  to  occur.  This  exercise  management  problem  appeared  to  merge  with 
other  problems  of  n anagmg  the  field  exercise. 

(2)  Case  2.  Information  about  Division  D came  from  discussions  with  a brigade 
commander  and  member  of  his  staff.  This  commander  had  given  concerted  attention  to  the 
implementation  of  battalion  field  evaluations  as  a part  of  ARTFP.  He  had  checked  out  his 
methods  by  applying  them  to  training  of  his  battalions  and  some  National  Guard  units.  He 
described  how  lie  conducted  battalion  field  exercises,  and  provided  formats  he  had  designed 
as  extensions  of  T&l  mission  outlines  However,  the  procedures  used  which  involved  at  one 
point  having  major  elements  from  three  battalions  in  the  field  opposing  one  another  according 
to  a carefully  designed  schedule  were  uniquely  his  own. 

(3)  Case  3.  Case  3 reinforced  the  finding  of  Case  1.  but  revealed  significant  new 
problems.  For  example.  Division  B had  used  the  so-called  integrated  ART!  P (referred  to  here 
as  the  two-battalion  field  exercise),  which  pitted  opposing  battalions  against  one  another,  while 
Division  A had  played  one  battalion  at  a time  against  an  OPI  OR.  While  the  administrative 
advantages  of  evaluating  two  battalions  at  once  are  obvious,  it  was  also  clear  that  the  “integrated" 
format  placed  heavier  demands  on  evaluators  and  communication  nets  and  was  more  difficult  to 
control.  Clearly  it  would  he  extremely  difficult  to  control  opposing  sides  in  a two-sided  exercise 
well  enough  that  activities  assumed  in  T&l:  mission  outlines  would  occur  in  a pre-planned  order. 
Further,  such  control  could  constrain  units  in  exercise  of  their  options,  thus  being  inimical  to 
basic  exercise  purposes.  Another  problem  which  became  more  obvious  across  cases  was  the 
double  hatting  among  F/Cs.  They  had  to  play  many  roles  concurrently.  One  important  need 
was  for  better  coordination  and  teamwork  among  F/Cs  so  as  to  better  anticipate  actions  by 
evaluated  units. 

(4)  Case  4.  By  the  fourth  field  evaluation  exercise,  the  data  collection  plan  was  much 
better  developed.  Recognizing  certain  advantages  of  the  two-sided  field  exercise,  we  attempted  to 
determine  whether  and  by  what  means  this  type  of  exercise  could  be  controlled.  This  required 
attention  to  F/C  communication  channels,  and  to  use  of  tactical  nets  by  each  battalion  as  well. 
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Procedures  followed  were  similar  to  those  used  lor  Case  3.  However,  in  addition,  tape  recorders 
were  used  to  record  communication  traffic,  including  messages  received  in  the  IOC  (Sorting 
out  recordings  later  and  relating  them  to  map  positions  of  units  on  time  lines  proved  to  he  an 
enormous  problem,  and  one  that  was  not  adequately  solved.) 

b.  Integration  of  information  front  cases.  The  above  description  of  cases  is  intended  to 
give  some  sense  of  the  progression  of  the  inquiry  as  we  went  from  one  case  to  the  next.  As  such, 
it  is  not  by  any  means  an  adequate  description  of  all  areas  covered.  These  areas  mentioned  above 
are  but  a few  of  many. 

Information  from  the  four  cases  could  now  be  compared.  Hie  Case  2 report  is  necessarily 
incomplete  since  it  does  not  include  field  observations.  These  comparisons  provide  insights  into 
how  current  operational  practices  are  similar  and  how  they  differ,  and  problems  common  to  all 
cases.  Differences  between  cases  permit  definition  of  alternative  command  options.  Similarities 
indicate  problems  that  are  more  or  less  common  across  the  board.  Definitions  of  common  prob- 
lems helped  to  direct  further  inquiry  and  to  guide  searches  for  their  solution. 

Our  data  are  presented  and  discussed  in  Chapter  3. 

2-4.  OTHER  SOURCES  OF  INFORMATION 

Two  additional  sources-  military  documents,  cognizant  officers  and  military  training  devices: 
and  concepts  from  the  scientific  literature  contributed  to  the  study.-' 

a.  Military  sources.  Among  military  sources  were  "How  to  Fight"  manuals,  observations 
of  the  CATTs  simulator  and  discussions  with  faculty  members  of  C&GSC.  and  participation  in 
two  symposia  on  ARTEP.  These  helped  to  put  field  observations  in  perspective,  to  better  appre- 
ciate constraints  under  which  units  must  operate  and  to  sharpen  our  definition  of  problems  and 
issues.  (We  make  this  distinction  between  issues  and  problems:  issues  represent  conflicts  between 
desired  goals.  They  require  intelligent  tradeoffs  to  be  partially  solvable.  Problems  are  subsets  of 
individual  issues.  Problems  can  be  solved.  The  inherent  conflict  between  emphasis  on  austerity 
and  emphasis  on  combat  realism  is  often  an  issue:  effective  training  of  evaluators  is  a problem.) 
Information  from  these  sources  was  correlated  with  that  drawn  from  case  studies  to  help  better 
define  problems  and  issues. 

b.  Scientific  concepts.  The  scientific  literature  provided  concepts  that  seemingly  might 
be  applied  to  resolution  of  certain  problems.  (The  proof  remains  to  be  established  in  Study 

't  ear  2!)  As  examples: 

( I ) Learning  theory.  Since  the  purpose  of  ARTEP  missions  is  training  and 
training  diagnosis,  concepts  and  principles  from  a well-established  body 
of  learning  theory  should  be  relevant. 


-,Sec  Attachment  A for  references. 


i 


(2)  Systems  analysis.  T&F.O  missions  place  three  systems  evaluated  unit, 

OPFOR  and  the  F./C  system  in  dynamic  interaction.  With  primary 
interest  on  the  evaluator/controller  group  as  a system,  system  analytic- 
concepts  should  he  applicable: 

(a)  as  guides  for  forecasting  likely  system  malfunctions,  and  for 
diagnosis  of  effectiveness  of  H /C  operations,  and 

(hi  in  providing  information  about  communication  procedures 
needed  within  the  R/C  Group,  and  how  this  group  can  best 
monitor  communications/actions  of  the  battalion  being 
evaluated. 

(3)  Psychometrics.  Psychometrics  can  help  to  improve  formats  for  T&RO 
standards  and  to  improve  the  ways  in  which  descriptive  items  might  be 
better  presented  to  evaluators. 

Thus,  military  sources  help  to  shed  light  on  issues/problems  identified  in  case  studies. 
Scientific  concepts  and  discussions  with  cognizant  officers  provide  guidance  as  to  possible 
tradeoffs  that  might  be  made  to  cope  intelligently  with  issues.  These  sources  serve  also  to 
direct  the  search  lor  solutions  to  problems. 

2-5.  DESCRIPTIONS  OF  ISSUES  AND  PROBLEMS 

As  noted  earlier,  the  model  was  developed  to  identify  and  classify  variables  important  to 
the  management  of  battalion  field  evaluation  exercises.  These  variables  and  their  interrelation- 
ships serve  as  background  to  a variety  of  issues  and  problems.  Thus,  variables  and  relationships 
are  the  “things”  that  problems  and  issues  are  all  about.  See  the  center  column  of  Figure  2-1 . 

It  shows  how  issues  and  problems  were  identified,  defined,  refined  and  finally  formulated  by 
successive  steps. 

Issues  and  problems  common  across  cases  and  which  appeared  most  important  were 
analyzed  one  at  a time.  For  each  issue/problem,  information  was  organized  as  follows: 

• Statement  of  the  nature  of  the  problem/issue. 

• Citation  of  relevant  documentary  sources  and  data. 

• Identification  of  key  casual  linkages  to  other  issues  in  the  matrix. 

• Identification  of  major  options  for  issue  resolution. 

• Statement  of  the  key  “pro’s”  and  “con's”  for  each  resolution  option. 

• Specification  ol  the  selected  option  and  discussion  of  the  supporting  reasoning. 
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Attachment  B presents  an  example  of  the  logical  format  and  contents  of  this  analytical  issue 
resolution  process. 


2-6  MATRIX  FOR  CLASSIFICATION  OF  ISSUES 

All  issues  were  classified  into  a single  matrix  shown  as  Figure  2-2.  No  single  table 
or  chart  can  convey  the  full  complexity  of  this  area  nor  reflect  the  many  interrelationships 
between  issues.  There  is  also  a rough  antecedent-consequent  relationship  between  entries 
in  the  four  columns.  The  relationships  between  Columns  l,  2 and  3 are  roughly  correlated 
with  roles  and  responsibilities  of  Army  echelons  in  descending  order. 

While  columns  do  not  exactly  map  to  formal  functions  of  Army  organizations,  ARTHP 
system  concepts  which  emanate  from  TRADOC/FORSCOM  fall  into  the  upper  part  of  Column 
1 the  broadest  category.  These  are  the  concepts  and  principles-  the  cornerstones  of  the 
ARTHPs  of  which  evaluation  is  one  key  element.  The  main  tools  available  to  TRADOC/ 
FORSCOM  for  remedy  of  identified  deficiencies  are  in  formulating  training  policy  guidance, 
and  in  guidance  revisions.  For  TRADOC,  such  guidance  may  take  a variety  of  forms 
including  manuals,  training  circulars,  etc. 

A second  class  of  issues  (the  lower  elements  of  Column  I and  all  of  Column  II)  describes 
the  basic  options  and  limitations  that  senior  commanders  and  training  managers  must  confront 
in  the  course  of  planning  and  conducting  external  evaluations.  This  category  includes  issues 
such  as  deciding  how  many  assets  to  spend,  choosing  the  exercise  format  (e.g..  single-battalion 
or  integrated  two-battalion  approach),  constructing  the  scenario,  specifying  the  problem 
control  procedures,  planning  the  training  of  evaluator/controller  teams,  supervising  their 
conduct  of  field  exercises,  etc. 

Column  III  contains  issues  and  technical  problems  of  a more  detailed  nature.  These 
issues/ problems  fall  under  the  heading  of  formulating  and  applying  the  evaluation  methodology. 
Among  these  are  the  appropriate  task  organization  of  Fvaluator/Controlier  Groups,  how  Group 
(unctions  are  performed  and  integrated,  evaluation  criteria  provided  by  mission  outlines, 
procedures  tor  their  employment  by  field  evaluators  to  rate  performance,  and  so  forth. 

Logically,  midway  between  Columns  III  and  IV.  is  a crucial  problem  area  namely  how 
feedback  from  evaluator  ratings  can  best  be  provided  to  members  of  evaluated  units  during 
field  exercises. 


I he  last  issue  category  (Column  IV)  deals  with  formulating  and  communicating 
evaluation  results,  and  the  application  ot  these  results  in  revising  training  practices  to  correct 
unit  deficiencies.  Procedures  in  this  area  close  the  feedback  loop  which  makes  AR  TIP  ;l 
complete  system  for  unit  training  and  evaluation. 
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2-7.  SUMMARY 


This  chapter  summarizes  the  study  objectives  and  research  approach.  An  iterative 
case  study  methodology  was  used.  Cases  consist  of  observations  of  battalions  conducting 
l&l'O  missions  drawn  trom  ARTKP  71-2.  Military  and  scientific  sources  were  used  to 
help  shed  light  on  issues  and  problems  identified  in  comparing  data  from  the  four  cases. 

Ihe  more  important  issues/ problems  were  analyzed  one  at  a time.  Military  sources  then 
provided  directions  and  clues  as  to  their  resolution. 

As  an  overview,  issues  are  summarized  in  Figure  2-2,  which  contains  four  columns. 

The  order  of  the  first  three  columns  corresponds  roughly  to  responsibilities  of  TRADOC,/ 
FORSCOM  and  field  units.  The  fourth  column  reflects  responsibilities  of  all  levels  of 
command  in  setting  policy  for,  and  providing  information  on  performance  to  the  units 
evaluated,  thus  closing  the  feedback  loop.  The  matrix  shown  in  Figure  2-2  is  further  articu- 
lated in  the  next  chapter.  Chapter  3 describes  issues  uncovered  in  field  observations  in  some 
detail.  Volume  II  suggests  concepts  and  recommendations  that  may  bear  on  their 
resolution. 
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ATTACHMENT  A 


DATA  SOURCES 


! hree  primary  sources  of  data  were  used  to  provide  the  information  base  for  this 
project.  They  were: 

( 1 ) Field  observations  and  interviews. 

(2)  Consultations  and  participation  in  workshops. 

(3)  Literature  sources. 

A-l . FIELD  OBSERVATIONS  AND  INTERVIEWS 

1 he  major  field  research  effort  was  the  series  of  field  observation  and  interview  site 
visits  undertaken  since  December,  l‘>76.  these  efforts  have  resulted  in  direct  observation  of 
external  evaluation  exercises  for  seven  battalions  and  surordinate  units.  Detailed  reconstruction 
of  procedures  for  three  additional  battalion  evaluations  was  performed.  Extensive  interviewing 
of  participants  occupying  all  important  roles  in  these  exercises,  and  contact  with  many  officers 
involved  in  evaluations  for  other  battalions  were  also  conducted.  The  battalions  studied  were 
drawn  from  four  separate  divisions- two  infantry  and  two  armor-  representing  a wide  geographi- 
cal dispersion  within  the  continental  United  States.  Future  field  work  is  tentatively  planned 
for  the  observation  of  battalion  evaluations  in  USAREUR,  and  for  field  assessment  of  the 
draft  Field  Guide  in  the  projected  second  contract  year. 
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A-2.  CONSULTATIONS  AND  WORKSHOPS 


In  addition  to  field  work  directly  related  to  the  conduct  of  AR  IIP  evaluations,  contact 
was  made  and  coordinating  meetings  held  with  personnel  from  the  following  organizations 


• PM-TESS.  Training  Support  Center,  U.S.  Army  Trailing  and 
Doctrine  Command,  Fort  Eustis,  Virginia. 


• Training  Development  Division.  U.S.  Army  Training  and  Doctrine 
Command,  Fort  Monroe.  Virginia. 

• Historical  Office.  U.S.  Army  Training  and  Doctrine  Command, 
fort  Monroe.  Virginia. 

• U.S  Army  Combat  Arms  Training  Board.  Fort  Benning, 

Georgia. 

• faculty,  staff  and  students.  Command  and  General  Staff 
School.  Fort  Leavenworth.  Kansas. 


• Directorate  of  Training  Developments,  U.S.  Army  Armor 
School,  Fort  Knox.  Kentucky. 

• Deputy  Commander  and  staff,  the  Infantry  School.  Fort 
Benning.  Georgia. 

• Cybernetics  Technology  Office,  Advanced  Research  Projects 
Agency.  DOD. 

• Human  Engineering  Laboratory.  Aberdeen  Proving  Ground, 

Maryland. 

• Historical  Evaluation  and  Research  Organization.  Dunn  Loring, 

Virginia. 

A-3.  LITERATURE  SOURCES 

a.  Training  Doctrine  and  Guidelines 

FM  21-6.  How  to  Prepare  and  Conduct  Military  Training,  Hq..  DA.  June  1974. 
TC  21-5-1.  Training  Management,  An  Overview  Hq.,  DA. 
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TC  21-5-1  Performance  Oriented  Training.  Hq..  DA 


TC  21-5-7.  Training  Management  in  Battalions  Hq.,  DA.  January  1977. 

TC  71-5.  REALTRAIN  Hq.,  DA.  January  1975. 

ARThP  71-21  Draft ).  Army  Training  and  Evaluation  Program  for  Combined  Arms 
Task  Eoree.  September  1976. 

ART!  P 71-2.  Army  Training  and  Evaluation  Program  for  Mechanized  Infantry /Tank 
Task  Force.  June  1977. 

USACCiSC.  Training  Management  Study  Guide  August  1977. 

FORSCOM  Regulation  350-1 . Active  Component  Training  Current  regulation.  1977. 
FORSCOM  Guidelines.  Training  Guidelines  FY  78.  May  1977. 

TRADOC/FORSCOM.  ARTEP  Workshop.  April  1976. 
b.  Tactical  Doctrine 

I'M  71-1.  The  Tank  and  Mechanized  Infantry  Company  Team  March  1976  (“How 
to  Fight  Manual”) 

FM  71-2.  The  Tank  and  Mechanized  Infantry  Battalion  Task  Force  July  1976 
(“How  to  Fight  Manual”) 

FM  100-5.  Operations.  July  1976. 

FM  105-5.  Maneuver  Control  Hq.,  DA.  December  1973. 

USAITAD  Report  No.  14-0-76.  Military  Operations  of  the  Soviet  Army . United  States 
Army  Intelligence  Threat  Analysis  Detachment.  25  May  1976. 

TC  30-4.  The  Motorized  Rifle  Regiment  Hq..  DA,  June  1975. 

TC  30-102.  The  Motorized  Rifle  Company  Hq  , DA.  September  1975. 
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c.  Scientific  Literature 

Daniel  R.  Ugen,  et  al.  Performance  Feedback  A Review  of  its  Psychological  and 
Behavioral  Effects.  (Army  Research  Institute,  Technical  Report  No.  1.,  February 
1977.) 

M.  Dean  Havron.  Evaluating  Combat  Systems  Establishment  of  Criteria  and  Their  Use 
in  Selection  of  Key  Systems  Factors  (Arlington,  Va.:  Human  Sciences  Research,  Inc.. 
March  1961.) 

Charles  Hitch.  “On  the  Choice  of  Objectives  in  Systems  Studies,”  in  D.P.  1 ckniun  (ed.t. 
Systems:  Research  and  Design.  (New  York:  J.  Wyley,  1961.) 

Clark  L.  Hull.  Principles  of  Behavior.  (New  York:  Appleton-Century-Crofts.  1951.) 

Martin  I.  Kurke.  “Operational  Sequence  Diagrams  in  System  Design  Description  of 
the  OSD,”  in  Human  Factors,  3,  No.  1.  March  1961. 

David  Magnusson.  Test  Theory.  (Reading,  Mass. : Addison-Wesley.  1966.) 

Stanford  L.  Optner  (ed.).  Systems  Analysis.  (Baltimore:  Penguin,  1973.) 

TRADOC  Pamphlet  350-30.  Interservice  Procedures  for  Instructional  Systems  Develop- 
ment (Author,  August  1975.) 

Harold  P.  VanC'ott  and  James  W.  Altman.  Procedures  for  Including  Haitian  Engineering 
Factors  in  the  Development  of  Weapons  Systems.  (Wright  Air  Force  Development  Center. 
October  1956.) 
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these  format  alternatives? 
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CHAPTER  3 


SUMMARY  OE  CASES: 

FIELD  OBSERVATION  DATA 

3-1 . CURRENT  ARTEP  FIELD  EVALUATION  PRACTICES 

a.  Introduction.  Field  observations  during  the  first  year  of  this  project  produced  data 
from  six  battalion-size  Field  evaluation  exercises.  This  section  discusses  the  broad  trends  identi- 
fied from  this  data.  Detailed  documentation  of  ARTEP  deficiencies  is  provided  in  Section  3-2. 

b.  ARTEP  System  Concepts.  The  implementation  of  ARTEP  as  a complete  system 
for  unit  training  and  evaluation  requires  that  field  units  identify  the  basic  principles  of  ART1P 
as  a system  and  that  they  apply  these  correctly.  Failure  to  do  so  has  three  possible  conse- 
quences: ( 1 ) ARTEP  is  viewed  as  being  indistinguishable  from  Alls;  (2)  ARTKP’s  unique 
features  are  overlooked  and  thus  not  used;  and  (3)  ARTEPs  are  used  inconsistently  across 
units  in  developing  training  policy.  Such  consequences  were  observed! 

c.  Evaluation  Exercise  Preparation  and  Conduct  Issues.  Current  field  practices  in 

the  preparation  and  conduct  of  evaluation  exercises  indicated  a lack  of  awareness  of  the  tasks' 
complexity,  or  the  need  to  provide  for  the  increased  complexity.  For  example,  some  units 
continue  to  use  the  two-battalion  opposing  force’s  format  although  the  one-battalion  format 
is  less  complicated  and  therefore  more  easily  managed.  Most  field  units  attempted  to  run  an 
excessive  number  of  missions  in  too  short  a period  of  time,  which  resulted  in  numerous  E/C 
personnel  interventions.  Both  of  these  deficiencies  increased  the  need  for  better  control 
during  the  exercise.  Yet  adequate  control  procedures  were  not  provided  for  in  the  Evaluation 
Plan. 

d.  Evaluation  Method.  Most  evaluator  teams  consisted  of  25  to  30  personnel  with  no 
distinction  being  made  between  evaluation,  control  or  simulation  functions  These  personnel 
were  typically  chosen  from  the  internal  assets  of  the  parent  brigade,  although  personnel  were 
also  drawn  from  elsewhere  in  the  division.  In  general,  training  of  the  evaluator  team  was  per- 
functory and  never  exceeded  a single  day. 

e.  Use  of  Results.  Most  of  the  units  observed  made  no  formal  provision  for  critiques  by 
individual  evaluators  of  the  units  to  which  they  were  assigned,  either  on-line  or  immediately 
following  the  exercise.  Common  practice  was  to  hold  a large  coordinating  meeting  after  the 
exercise,  in  which  ratings  were  finalized  and  transmitted  in  summary  form  to  the  sponsoring 
commander. 


3-2.  DOCUMENTATION  AND  DELINEATION  OF  KEY  AREAS  OF  DEFICIENCY 


Table  3-1  summarizes  results  o!'  the  observations  of  selected  field  unit  ARTEP  evaluations. 
This  table  is  keyed  to  the  scheme  of  specific  issues  and  types  of  issues  introduced  in  the  issue 
classification  matrix  presented  as  Figure  2-2  in  the  previous  chapter.  The  data  elements  in 
individual  cells  correspond  to  specific  observations  for  specific  units.'  These  focus  on  unit 
activities  which  were  seen  as  “problems”  or  deficiencies  in  the  use  of  ARTEP  principles  and 
official  guidelines.  The  following  paragraphs  detail  these  observations,  and  cite  common 
patterns  and  tendencies.  The  construction  of  an  overall  framework  for  the  organization  of  the 
data  followed  these  tentative  efforts  to  find  commonalities  in  the  data  collected  from  the  field. 

a.  ARTEP  System  Concept  Issues  and  Initial  Applicatons 

(1)  Interpretation  of  Key  ARTEP  Systems  Concepts.  Under  this  heading,  four 
areas  of  weakness  were  identified  during  observations  of  ARTEP  evaluation  exercises.  These 
areas  were: 

(a)  Confusion  about  tailoring  the  ARTEP  to  tit  individual  unit  needs. 

( b)  Lack  of  understanding  of  techniques  for  application  of  specific 
T&E  standards  for  evaluation  and  training. 

tc)  Tendencies  toward  “cycling”  and  “peaking"  in  the  overall  training/ 
evaluation  schedule,  despite  ARTEP  emphasis  to  the  contrary. 

(d)  Uncertainties  about  the  appropriate  nature  and  degree  of  respon- 
sibilities of  specific  HQ/staff  echelons  in  the  overall  effort  and 
specific  phases. 

There  was  a tendency  by  most  performing  units  to  treat  ARTEP  71-2  as  the  last  word, 
rather  than  as  a broad  advisory  outline  and  flexible  tool.  This  resulted  in  an  often  unimagina- 
tive, literal,  and  overly  mechanical  application  of  the  T&E  outlines  to  the  unit’s  training/evalua- 
tion program  as  shown  in  Table  3-1.  under  I. A.  l.a.  As  a result,  efforts  to  tailor  ARTEPs  to 
specific  unit  training  weaknesses,  missions,  and  local  circumstances  appeared  sparse.  It  was 
also  evident  that  this  was  reinforced  by  a lack  of  definitive  Army-wide  guidance  for  conduct 
of  field  exercises  and  application  of  specific  T&E  standards  to  unit  training  or  evaluation. 

Lack  of  guidance  led  to  overdependence  on  individual  evaluators'  interpretations  and  judgments 
during  the  formal  evaluations.  This  problem  existed  among  most  performing  units,  as  shown 


' The  categories  shown  in  die  lablc  evolved  as  we  observed  successive  cases.  We  had  bill  lew  of  them  as 
reminders  when  we  made  field  observations.  Many  entries  into  cells  arc  based  on  the  best  collective  recollec- 
tions of  observers  from  the  research  team.  Finally,  entries  in  the  table,  and  in  the  accompanying  explanatory 
discussions  cite  what  we  conceive  as  deficiencies  in  current  practices.  These  deficiencies  are  the  focus  of  the 
study.  Effective  practices  receive  less  attention. 

v> 
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The  items  reported  in  this  table  deal  exclusively  with  nhservcd  deficiencies  in  the  evaluation  procedure'  of  units  selected  for 
field  study  In  every  case,  such  deficiencies  should  he  interpreted  against  a predominantly  positive  background  of  c flee  live 
procedures,  eagerness  to  profit  by  experience,  and  enthusiasm  for  ARTbP  as  an  innovative  training/evaluation  system 
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under  l.A.2a  in  Table  3-1 . It  did  not  apply  in  the  ease  of  Division  D where  elaborately  codi- 
fied definitions  of  specific  Standard  items  were  the  rule.  An  alternative  solution,  which  does 
not  assume  we  can  greatly  reduce  the  subjectivity  in  judgments,  involves  training  evaluators 
to  exercise  wise  subjective  judgments. 

At  the  pay-off  end  of  the  evaluation  process,  it  appeared  that  division  training  sched- 
ules were  too  fixed  and  inflexible  to  make  more  than  nominal  use  of  results  of  ARTEP  evalua- 
tions. Typically  the  master  schedules  are  prepared  a year  in  advance,  with  “prime  time”  training 
periods  scheduled  for  each  battalion  only  once  in  that  interval.  This  perpetuates  the  peaking 
phenomenon,  and  makes  full  battalion  remedial  exercises  exceedingly  hard  to  squeeze  in.  In  all 
cases  observed  and  shown  under  I.  A. 3. a in  Table  3-1.  there  was  little  evidence  of  sustained  bat- 
talion level  post-evaluation  training.  The  peaking  tendencies  in  the  overall  T&E  program  may 
well  be  the  most  essential  factor  under  this  heading  because  it  involves  the  integration  of  battalion 
field  exercises  with  all  other  forms  of  training. 

As  a last  major  problem,  there  appeared  to  be  some  confusion  as  to  procedures  for 
establishing  effective  coordination  and  a clear  division  of  labor  between  division,  brigade  and 
battalion  echelons  during  various  phases  of  the  evaluation  eftort.  Our  research  team  did  not 
actually  observe  the  formation  of  an  “ARTEP  Committee”  nor  the  planning  phase  of  an  ex- 
ternal evaluation  exercise.  Rather  our  observations  are  based  upon  interviews  conducted  the 
day  before  the  inception  of  an  exercise  with  staff  personnel  involved  in  the  planning  stage. 

Results  of  these  interviews  are  presented  under  I.  A. 4. a in  Table  3-1 . As  extreme  examples, 
individual  brigades  either  performed  division-wide  planning  functions,  or  operated  with  virtually 
no  help  from  division  in  any  phase. 

From  these  observations,  it  is  apparent  that  some  of  the  most  central  philosphical 
principles  of  the  ARTEP  system  are  not  effectively  grasped  in  field  units.  On  a somewhat  less 
abstract  level,  similar  types  of  issues  are  detailed  in  the  next  section. 

(2)  Using  Evaluation  as  an  ARTEP  Tool.  Five  major  problem  areas  were  identified 
with  respect  to  the  use  of  evaluations  as  tools  within  the  context  of  the  complete  ARTEP 
system. 

(a)  Uncertainty  about  when  to  conduct  the  various  types  of  evaluations. 

(b)  Problems  experienced  in  distinguishing  between  the  various  types  of 
evaluations  (e.g.  intemal/external.  formal/informal). 

(c)  Problems  in  attempting  to  establish  the  correct  mix  of  alternative 
training  and  evaluation  options. 

(d)  Problems  in  using  the  external  evaluation  as  a training  and  diagnostic 
tool  rather  than  as  a report  card. 
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(e)  Uncertainty  about  how  to  balance  evaluation  and  training  activities 
and  objectives  “on-line.”  i.e.  during  the  actual  battalion  evaluation 
exercises. 

Generally,  ARTEP  external  evaluations  are  routinely  scheduled  once  each  year,  evi- 
dently independent  of  any  specific  assessments  of  unit  needs,  level  of  evaluation  readiness,  etc. 
lor  example,  Table  3-1  under  l.B.l.b  shows  that  division  scheduling  of  external  evaluations  for 
each  specific  brigade/battalion  was  apparently  not  coordinated  with  the  progress  of  specific 
brigade/battalion  training  programs  within  these  annual  intervals.  In  both  aspects,  the  core 
AR IT-P  principle  of  tailoring  the  evaluation  process  to  meet  the  particular  needs  of  units 
collides  with  the  very  heavy  coordinating  and  scheduling  constraints  that  confront  divisions 
and  higher  command  levels,  as  they  juggle  access  to  training  areas,  multiple  mission  commit- 
ments, and  so  on.  A Division  Master  Training  Schedule  documenting  the  typical  annual  spac- 
ing ot  external  evaluations  is  presented  in  Table  3-2.  Inspection  of  this  chart  reveals  only 
two  elements  within  the  entire  division  performed  an  “ARTEP”  more  than  once  a year. 

Tlie  second  major  problem  area  is  closely  linked  with  the  first.  Many  field  personnel 
interviewed  were  confused  as  to  how  the  ARTEP  approach  really  differed  from  ATTs.  As 
indicated  in  Table  3-1  under  l.B.2.a.  few  sampled  units  conducted  any  total  internal  evaluation 
activities.  A representative  of  TRADOC  suggested  internal  battalion  field  exercises  be  con- 
ducted quarterly  for  several  reasons.  One,  to  maintain  proficiency;  two,  because  ammunition 
is  distributed  quarterly ; and  three,  personnel  instability  dictates  regular  internal  evaluations. 

In  parallel  fashion,  units  were  confused  about  how  much  and  when  to  do  which  type  of  evalu- 
ation. Partly  due  to  this  confusion,  field  units  appeared  to  have  little  basis  for  deciding  how 
much  emphasis  to  give  to  battalion-sized  external  evaluations,  and  how  much  to  give  (spend) 
for  internal  evaluations  and  other  T/E  activities.  This  resulted  in  apparent  over-spending  and 
over-emphasis  on  formal  (external)  evaluations  in  several  units,  and  under-emphasis  in  several 
others  as  indicated  in  Table  3-1 . under  l.B.3.a.  One  sergeant  major  summarized  a frequently 
encountered  view,  that  battalion  ARTEP  evaluations  are  a very  expensive  way  to  check  out 
commanders  and  staffs,  for  whom  the  use  of  simulation  games  and  CPXs  could  do  a better 
and  cheaper  job.  As  an  illustration  of  the  effects  of  over-spending,  following  one  ART1P 
exercise  the  brigade  commander  conceded  that  his  annual  POL  allowances  were  completely 
depleted.  Division  D.  by  contrast,  reportedly  made  do  with  relatively  few  assets  to  achieve 
relatively  high  quality  evaluations  (largely  as  the  result  of  very  thorough  planning  and  under- 
standing of  basic  ARTE  P concepts).  Taken  together,  the  limited  data  now  available  tend  to 
associate  overspending  and  overemphasis  with  division-centered  approaches  to  external  evalua- 
tion. 

The  evidenced  confusion  between  internal  and  external  evaluations  hears  on  issues 
under  I B. 4 in  Table  3-1 . So  long  as  field  units  do  not  distinguish  procedurally  between  in- 
ternal and  external  evaluations  there  is  always  going  to  be  some  doubt  among  battalion 
personnel  as  to  whether  or  not  performance  on  a battalion  ARTI  P will  be  used  for  administra- 
tive purposes  as  input  to  the  battalion  commander's  “report  card.”  There  was  ample  evidence 
■n  the  field  that  many  units  continue  to  view  the  external  evaluation  as  more  a “report  card" 
or  “test"  than  as  a source  of  usable  diagnostic  data.  A symptom  of  this  mistaken  percepth  • 
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was  a lack  of  provision  in  the  evaluation  plan  for  detailed  feedback  procedures.  (As  indicated 
in  Table  3-1,  under  I.B.4.b,  Division  D was  again  an  exception;  its  plans  were  well  developed.) 

In  general,  there  was  a tendency  to  focus  on  the  T&E  sat/unsat  ratings,  rather  than  on  detailed 
critical  notations.  In  several  divisions,  the  atmosphere  at  brigade  and  battalion  levels  was 
characterized  by  intense  competitive  pressures,  rumors  of  poorly  performing  battalion  com- 
manders being  relieved,  and  so  on.  Commanders  and  troops  still  talked  about  “taking 
ARTEPs”  as  one  takes  a test.  In  this  sense,  they  may  be  said  to  have  been  more  interested  in 
achieving  “S’s”  and  avoiding  “U’s”  than  receiving  frank,  detailed  feedback  about  unit  strengths 
and  weaknesses.  This  defensive  attitude  sometimes  led  to  efforts  at  negotiation  between  com- 
manders and  evaluators  over  rulings  and  ratings;  and  to  some,  reluctance  by  evaluators  to  make 
negative  judgments.  Members  of  our  research  team  discussed  this  problem  of  dual  usage  with 
a senior  officer  at  TRADOC.  He  suggested  that  the  two  functions,  i.e.  training  and  account- 
ability reckoning,  be  maintained  but  separated  procedurally  by  conducting  two  battalion 
ARTEPs  annually.  One  field  exercise  would  be  primarily  for  training  diagnosis  which  presum- 
ably would  preceed  the  other  for  testing.  In  this  way  the  Army  might  increase  the  credibility 
of  the  use  of  field  exercises  for  “sanction  free”  training  diagnosis.  However,  feasibility  ques- 
tions remain  due  to  serious  constraints  on  resources. 

Finally,  field  observers  repeatedly  recorded  doubts  over  how  to  deal  with  training  and 
feedback  activities  while  the  battalion  evaluation  was  in  progress.  A primary  source  of  this 
confusion  was  the  lack  of  definitive  policy  and  procedural  guidelines  in  the  evaluation  plan 
for  the  administration  of  on-line  critiques  and/or  instruction.  As  a consequence,  several  types 
of  uncoordinated  training  activities  were  observed  which  tended  to  undermine  the  realism  and 
the  logical  How  of  the  exercises.  For  example,  issue  area  I.B.S.b  in  Table  3-1  shows  that  in  a 
number  of  cases,  missions  were  interrupted  “prematurely"  or  arbitarily  for  immediate  perfor- 
mance ritiques,  instruction,  or  task/mission  repetitions. 

(3)  Unit  Contextual  Issues.  One  major  facet  of  ART1  P involves  tailoring  T/E  efforts 
to  match  particular  unit’s  needs  and  capabilities.  Several  types  of  problems  were  identified  that 
relate  to  this  process.  Among  the  most  important  were; 

(a)  Development  of  the  Evaluation  Plan,  particularly  in  the  selection  and 
tactical  definition  of  missions,  which  did  not  fully  reflect  the  distinc- 
tive configuration  of  TO&E  and  contingency  missions  for  the  units 
being  evaluated. 

(b)  Less  than  full  and  imaginative  exploitation  of  available  terrain  for 
conduct  of  the  evaluation  problem,  chiefly  by  recourse  to  employ- 
ment of  overly  familiar  terrain  in  routinized  fashion. 

(c)  Development  and  attempted  use  of  overly  ambitious  Evaluation 
Plans  requiring  unrealistic  levels  of  sophistication/proficiency  for 
both  evaluator  groups  and  evaluated  units  to  execute  effectively. 
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By  and  large  scenarios  did  not  reflect  the  particular  mix  ol  IO&1  missions,  operational 
contingency  missions.  “ALA)”  numbers,  and  so  on.  which  define  the  probabilities  for  actual 
combat  situations  that  each  individual  unit  laces  The  training  doctrinal  literature  (e.g.  TC  21- 
5-7)  mandates  this  as  the  starting  point  tor  design  of  a unit  T/E  program.  Instead.  Evaluation 
Plans  and  scenarios  were  virtually  interchangeable  across  our  entire  sample  of  Tank/Mecham/.ed 
Infantry  task  forces. 

Terrain  limitations  are  often  such  that  with  tiring  ranges  in  use  and  other  training 
activities,  it  is  difficult  to  find  sufficient  room  for  tank  /mechanized  battalions  to  maneuver. 

Fresh  thought  as  to  how  to  get  maximum  evaluation  exercise  benefits  from  imagina- 
tive use  of  familiar  terrain  is  warranted  Particularly  al  Division  B there  was  a pronounced 
pattern  of  adopting  stale  terrain  situations  and  usages  for  employment  in  the  evaluation  exer- 
cises. Although  obviously  there  are  real  limits  to  the  flexible  use  of  training  areas,  repetition 
of  the  same  missions  over  the  same  ground  does  little  to  inject  surprise,  fresh  tactical  thinking, 
or  troop  enthusiasm  into  the  ARTEP  exercise. 

Finally  and  this  was  universal  I valuation  Plans  called  for  much  higher  levels  ol 
evaluator/controller  expertise  and  proficiency  by  the  unit  evaluated  than  were  present  Hie 
third  issue  area  under  I.C  in  I able-  3-1  interacts  with  the  previous  issue  in  so  far  as  evaluation 
plans  contained  too  many  missions  which  were  unrelated  to  operational,  real  world  contingency 
missions.  We  recommend  simpler  less  ambitious  scenarios  and  formatting  Tins  would  help 
eliminate  frequent  lapses  in  exercise  control  and  realism,  and  situations  where  units  were  called 
upon  to  execute  complex  tactical  exercises  when  the  inability  to  execute  fundamentals  is  ques- 
tionable. In  such  cases,  scarce  resources  were  being  misallocated  due  to  readih  preventable 
causes. 

(4)  Evaluation  Task  Assignment  Issues  \KTI  P and  associated  training  documents 
call  tor  high  levels  of  decentralization  in  all  aspects  o I o iit  training  and  evaluation  procedure 
However,  uncertainty  concerning  how  this  should  be  nterpreted  in  the  assignment  ol  evaluation 
roles  to  participating  division  brigade 'battalion  ommand  and  siall  elements  was  interred  by 
HSR  researchers  from  conversations  with  the  personnel  involved  in  tlu  planning  stage 

In  one  case,  shown  in  (able  3-1  under  I D I a.  the  effort  was  completely  centralized 
at  the  division  level.  A single  1 valuation  Plan  was  created  and  used  for  j!I  battalions  in  that 
division.  Obviously,  efforts  to  tailor  the  process  to  specific  battalion  circumstances  were 
minimal  in  this  case  The  same  may  be  said  for  the  level  of  participation  and  planning  exen- 
ence  gained  by  brigade  battalion  personnel  Division  f was  a clear  exception  to  the  division 
centralized  task  organization  of  the  ARTI  P Planning  Committee  Pre-exercise  interviews  with 
the  C-3  revealed  that  division  attempted  to  increase  the  participation  of  brigade  personnel  in 
the  preparation  phase  by  tasking  the  Assistant  Brigade  S-3  with  designating  the  I valuation  Plan. 
The  plan  was  then  distributed  to  selected  stall  and  commanders  for  inputs  to  refine  the  design. 
Tile  plan  and  solicited  inputs  were  then  sent  to  the  (»-3  for  final  approval 
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In  some  instances,  virtually  no  direction  from  the  division  was  forthcoming  in  the 
preparatory,  execution  or  feedback  phases  of  the  complete  evaluation  process.  In  all  cases 
observed  and  reported  under  l.DJ.a  in  Table  3-1 , at  least  some  of  the  leadership  and  staff 
talent  at  the  division/brigade  echelons  was  not  provided  a meaningful  role  in  the  field.  This 
resulted  in  brigade  commanders  drifting  in  and  out  of  the  scene,  looking  over  their  battalion 
commander’s  shoulder,  and  distracting  the  efforts  of  others  because  commanders  were  “being 
simulated”  by  somebody  else  in  the  exercise  plan.  We  feel  that  frequently  senior  commanders 
gave  too  much  attention  to  the  battalion  being  evaluated;  too  little  to  the  effective  operation 
of  the  F./C  Group. 

Similarly,  there  was  substantial  ambiguity  as  to  who  was  responsible  for  what  in 
feeding  back  evaluation  data  to  remedial  training  practices.  This  problem  was  aggravated  by 
the  fact  that  Evaluation  Plans  put  out  by  the  sponsoring  divisions/brigades  did  not  specify 
the  roles  or  tasks  of  various  division/brigade  personnel  in  utilizing  the  evaluation  results. 

Again  to  cite  extreme  cases,  brigade  commanders  who  had  to  mount  the  entire  effort  virtually 
alone  were  reluctant  to  let  division  people  dabble  with  how  the  results  were  to  be  utilized. 
They  preferred  instead  to  supply  division  with  minimal  reports  and  information. 

b.  Evaluation  Exercise  Preparation  and  Conduct  Issues 

( 1 ) Evaluation  Exercise  Format.  The  major  problem  areas  identified  with  respect 
to  basic  Evaluation  Plan  design  decisions  were: 

(a)  Use  of  two-battalion  (“OPFOR”)  exercise  formats  without  full 
awareness  of  the  deficieneies  and  difficulties  of  this  approach. 

(h)  Confusion  about  the  appropriate  logic  and  procedures  for  deter- 
mining the  composition  of  the  performing  task  force  and  supporting 
units. 

(c)  Over-concentration  of  evaluation  assets  at  the  battalion  level,  with 
consequent  losses  of  key  data  at  the  lower  unit  levels. 

(d)  Uncertainty  regarding  how  to  coordinate  battalion  and  sub-unit 
evaluation  procedures. 

Despite  FORSCOM  and  TRADOC  guidance,  several  divisions  continued  to  employ 
the  two-battalion  (“OPFOR")  format  in  evaluation  exercises  as  shown  in  Table  3-1  under 
II  A 1 .a.  They  remain  outspoken  in  defending  this  approach,  based  on  the  highly  questionable 
view  that  it  is  a more  practical,  cost-effective,  and  realistic  format.  Having  given  considerable 
attention  to  this  issue,  we  believe  that  the  single  battalion  format  is  more  easily  managed, 
permits  more  authentic  representation  of  Warsaw  Pact-type  OPFOR  elements,  allows  for  a 
greater  degree  of  exercise  control,  and  is  subject  to  less  costly  and  more  rigorous  evaluation. 
Therefore,  we  believe  it  is  to  be  preferred. 
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There  was  a great  deal  of  uncertainty  regarding  the  number  and  types  of  supporting 
elements  to  put  in  the  field,  or  simulate.  In  many  instances,  critical  combat  and  service  support 
elements  were  either  poorly  simulated  or  omitted  from  the  exercise  altogether,  thus  detracting 
from  the  realism  of  the  exercise.  On  what  is  perhaps  a picayune  further  point,  we  were  inclined 
to  question  the  unreflecting  and  mechanical  way  in  which  units  created  Tank/Mechanized  In- 
fantry Task  Forces  by  always  simply  swapping  company-sized  elements  The  “How  to  Fight" 
Manuals  emphasize  flexibility  in  tailoring  Task  Forces  to  specific  tactical  settings. 

Another  common  problem  was  questionable  balance  in  the  distribution  of  evaluation 
assets  between  battalion  elements.  There  was  a tendency  to  assign  a disproportionate  number 
of  evaluation  personnel  to  observation  of  various  aspects  of  battalion-level  activities.  As  a 
result,  mission-critical  performance  dimensions  observable  only  at  the  lower  unit  levels  were 
inadequately  covered- 

Finally,  there  was  a wide  divergence  in  approaches  to  the  conduct  of  “sub-unit”  evalua- 
tions, with  some  less  successful  than  others.  In  several  cases  listed  in  Table  3-1  under  lI.A.4.a, 
parent  units  attempted  to  conduct  the  bulk  of  these  evaluations  concurrent  with  the  battalion 
evaluation.  This  stretched  evaluator  resources  very  thinly  and  left  unrealistic  gaps  in  battalion 
formations.  One  G-3  concluded  that  concurrent  sub-unit  evaluations  detract  from  participants’ 
perspective  of  the  whole.  In  other  cases,  listed  under  II.A.4.b,  “off-line”  approaches  were  not 
scheduled  so  as  to  avoid  troop  fatigue,  either  during  the  battalion  exercise  or  the  sub-unit 
evaluations. 

(2)  Evaluation  Plan/Scenario  Construction.  Five  common  weaknesses  of  the 
Evaluation  Plans  and  associated  scenarios  were  identified. 

(a)  Commitment  to  overly  complex  evaluation  requirements  resulted 
in  unwieldy  exercise  scenarios.  (In  order  to  make  these  "work." 
units  were  often  given  advance  copies  of  scenarios  and  mission 
schedules.) 

(b)  Tile  universal  attempt  to  cram  an  excessive  number  of  missions 
into  the  ()()  hour  ( + ) exercises. 

(c)  Prior  disclosure  of  the  detailed  scenario,  and  similar  compromises 
of  tactical  uncertainty,  etc. 

(d)  Plan/scenarios  which  kept  leaders  very  busy  but  often  failed  to 
exercise  troops  adequately. 

(e)  Plans  which  permitted  “endurance  test"  performance  by  first-line 
leaders  without  requiring  recourse  to  back-up  leadership  capabilities. 
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In  general,  exercises  contained  too  many  complicated  combinations  of  missions  com- 
pressed into  too  short  a period  of  time.  As  a result,  performing  units  were  forced  to  attempt  to 
complete  missions  within  an  unrealistically  short  period  of  time.  Not  infrequently  there  was  no 
time  left  for  subordinate  elements  to  practice  troop  leading  procedures.  For  the  same  reason, 
it  was  frequently  necessary  for  controllers  to  intervene  and  adjust  tactical  situations  in  relation 
to  the  fore-ordained  schedule  of  events.  Additional  reasons  for  interventions  were  lack  of 
planning  by  the  E/C  Group  so  as  to  anticipate  battalion  actions.  This  undoubtedly  resulted 
from  an  insufficient  amount  of  pre-exercise  time  spent  training  and  assigning  roles  to  evaluators 
and  controllers.  A further  consequence  often  observed  was  the  high  visibility  and  obtrusiveness 
of  E/C  personnel  in  the  field.  But  this  varied. 

In  some  cases  evaluators  did  not  stay  with  their  units  and  could  not  be  found.  In 
others  they  stationed  themselves  (or  rode  around  in  jeeps)  just  in  front  of  units  being  evaluated, 
thus  helping  to  expose  their  positions  to  the  opposing  force.  The  compression  of  missions  also 
tended  to  produce,  by  direct  and  indirect  causes,  overburdening  of  unit  leaders  from  company 
up  and  under-utilization  of  troops  and  back-up  leader  capabilities.  While  troops  typically  were 
active  only  sporadically,  (and  frequently  perceived  the  exercise  as  "just  another  terrain  ride”) 
company  level  and  higher  leaders  often  went  sleepless  for  the  duration  of  the  exercise. 

Die  Evaluation  Plan/Scenarios  also  tended  to  take  on  "canned”  or  predetermined 
characteristics.  Unit  leaders  were  almost  always  aware  of  the  sequence  of  missions  and  events 
in  advance,  and  generally  were  able  to  rehearse  before  the  evaluation  was  implemented.  Re- 
portedly in  Division  A,  company  level  units  did  rehearse  in  anticipation  of  the  known  scenario. 
Nowhere  did  we  find  this  practice  discouraged.  In  some  units,  this  serious  compromise  of  sur- 
prise. realism  and  spontaneity  was  defended  as  a virtue.  The  logic  was  "the  more  the  unit 
knows  in  advance,  the  better  it  can  get  ready  ” Of  course,  there  were  some  surprises  in  the  two- 
sided  exercises.  Too  often  E/C  personnel  were  unprepared  for  what  was  going  to  happen  next, 
thus  being  in  the  wake  of  events,  they  were  unable  to  avert  the  muzzle-to-mu/zle  confrontations 
which  occurred. 

(3)  Tactical  Problem  Control.  The  exercise  of  adequate  control  while  achieving 
adequate  degrees  of  tactical  realism  represented  a critical  deficiency,  and  one  that  is  not  readily 
remedied.  Among  the  most  serious  shortcomings  were: 

(a)  Both  a lack  of  adequate  support  and  a lack  of  sufficient  planning 
for  tactical  simulation 

(b)  Failure  to  adequately  distinguish  and  prescribe  evaluation  and 
tactical  control  simulation  procedures. 

(c)  In  some  instances,  unrealistic  employment  of  OPFOR  elements. 

(d)  Inadequate  and  untimely  play  of  weapons  effects  and  signatures, 
as  well  as  declaration  of  casualties  and  equipment  losses. 
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Serious  shortcomings  were  the  rule  with  respect  to  nuteucl  and  personnel  commit- 
ments in  support  of  control  and  tactical  simulation  efforts.  No  units  had  available  adequate 
pyrotechnics  even  to  begin  to  approach  "realism"  in  the  simulation  of  weapons'  firings  and 
impact  signatures.  Perhaps  more  significantly.  I.  valuat  ion/Con  trol  Plans  typically  tailed  to 
spell-out  sufficiently  well  how  weapons  effects  and  force  ratios  were  to  be  represented.  The 
same  was  true  of  tactical  "arbitration"  and  "umpiring"  rulings  in  every  exercise  observed  A 
comparison  of  evaluation  control  plans  across  units  revealed  no  discernable  distinction  between 
one  and  two-battalion  exercises  We  believe  the  two  formats  require  different  control  measures. 
As  for  personnel,  the  duties  of  the  1/C  personnel  were  not  well  defined,  nor  were  there,  to  our 
knowledge,  any  rules  or  guides  for  shifting  personnel  to  the  scenes  of  hottest  action.  As  a 
result,  control  often  faltered,  units  went  “off  the  board”  or  became  entangled  muzzle-to-muzzle 
Much  potentially  useful  training  time  was  wasted  in  sorting  people  out  and  re-establishing  the 
tactical  How. 

In  addition,  we  found  universal  problems  with  the  size,  composition,  and  tactical  plan 
of  opposing  forces  in  the  exercises  observed.  Such  problems  as  realistic  force  ratios,  simulating 
Warsaw  Pact  OPFOR  tactics,  etc.,  are  unsolvabic  in  the  two-battalion  format.  The  OPFOR.  on 
the  other  hand,  represents  a separate  and  more  flexible  evaluation  instrument.  For  example. 
Division  A could  have  set  up  the  OPFOR  to  play  Soviet  tactics.  However,  this  area  appears  to 
receive  little  attention. 

Finally,  few  units  provided  for  realistic  play  of  staff  and  support  elements.  A closely 
related  deficiency  was  a lack  of  detailed  follow-through  on  the  processing  of  casualties,  equip- 
ment losses.  POWs  and  raw  intelligence.  Division  C was  a clear  exception  in  that  they  attempted 
to  integrate  REAL TRAIN  identification  techniques  with  their  control  measures.  However,  there 
was  no  net  control  station  to  monitor  and  record  inflicted  casualties  as  there  is  in  RhALTRAIN. 
hence  the  designation  in  Table  3-1.  under  II.C.4.b.  The  same  rationale  holds  lor  II. C .4.c  and  d. 
Although  RFALTRAIN  numbers  were  placed  on  tanks,  use  of  those  numbers  in  the  declaration 
of  casualties  and  equipment  losses  was  inconsistent. 

c.  Evaluation  Methodology 

( 1 ) Evaluator/Controller  Group  Attributes.  Key  deficiencies  of  E/C  Group  organi- 
zation and  training  were 

(a)  Problems  of  Group  organization  and  procedure. 

(b)  Deficiencies  in  personnel  selection  and  training  procedures. 

(c)  Shortcomings  in  the  nature  and  degree  of  support  for  the 
E/C  Group. 

There  were  serious  organizational  problems.  In  our  view,  personnel  assignments  were 
not  clearly  defined  or  coordinated.  “Double-hatting"  often  forced  E/C  personnel  to  neglect 
critical  duties  (either  in  evaluation  or  simulation).  We  were  sometimes  confused  (though  Army 
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participants  may  not  have  been)  as  to  command  structure  and  operational  control  functions. 
Linkage  with  OPFOR  elements  was  often  weak  and  ill-defined.  There  was  no  confusion  as  to 
who  was  in  command  during  Division  C"s  exercise  because  the  brigade  commander  was  established 
as  the  Test  Control  Directorate.  This  Division  also  proved  to  be  an  exception  at  the  other  end 
of  the  K/C  Group  organization.  In  most  cases,  there  were  too  few  evaluators  assigned  to  company 
and/or  platoon  units.  Yet  interviews  with  a G-3,  who  had  participated  in  the  planning  stage  ol 
several  battalion  exercises,  revealed  a strong  preference  for  decreasing  or  eliminating  the  number 
of  evaluators  assigned  to  performing  platoons. 

Other  problems  were  a general  lack  of  provision  for  an  L/C  Group  reserve  capability 
for  evaluating  attached  units.  (This  problem  is  quite  distinct  from  that  of  coordinating  on-line 
assignments  of  evaluators  amongst  maneuver  elements.)  There  were  repeated  communications 
breakdowns  due  to  the  absence  of  an  adequate  number  of  operable  radios  and  group  nets.  Too 
frequently,  the  radios  provided  turned  out  to  be  inoperable  in  the  field.  As  indicated  in  Table 
3-1  under  111. A.  1 .b,  most  units  provided  only  one  radio  net/frequency  to  the  entire  L/C  Group. 
An  exception  was  Division  C’s  radio  net  system.  Two  overlapping  nets  were  used,  one  at  bat- 
talion which  could  be  heard  by  all  L/C  personnel  and  one  at  company  over  which  transmissions 
could  not  be  heard  at  battalion. 

Training  procedures  for  the  L/C  Group  were  uniformly  found  to  be  inadequate.  Per- 
sonnel were  very  frequently  detailed  from  neighboring  battalions,  and  were  not  of  the  prescribed 
rank  as  indicated  in  Table  3-1  under  111. A. 2. a.  Lack  of  adherence  to  guidance  provided  in  71-2 
regarding  the  appropriate  rank  of  evaluators  may  have  decreased  credibility  of  feedback.  How- 
ever, we  suspect  that  the  problem  of  relative  ranks  between  evaluator  and  evaluatee  can  be 
largely  reduced  by  evaluator  training.  Much  more  harmful  to  the  overall  evaluation  effort  was 
neglect  of  the  minimum  requirements  for  training  personnel  for  their  evaluation  and  control 
duties.  Training  observed  fell  far  short  of  that  recommended  in  71-2. 

Technical  support  of  the  L/C  team  was  often  deficient,  primarily  in  the  areas  of  trans- 
portation and  communication  as  shown  in  Table  3-1  under  III. A. 3. 

(2)  Evaluation  Criteria.  A considerable  number  of  “technical"  problems  were 
identified  which  are  inherent  in  the  current  71-2  T&l  outlines.  These  did  not  reflect  short- 
comings on  the  part  of  specific  units.  These  may  be  roughly  classified  as 

(a)  Apparent  lack  of  correspondence  between  Task.  Conditions 
and  Standards  components. 

(b)  Questionable  linkage  between  doctrinal  literature  and  the  T&l  O 
mission  contents. 

(c)  Apparent  lack  of  provision  for  critical  events  and  behaviors  in 
many  mission  outlines. 
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(d)  Variations  in  the  length  and  intensity  of  treatment  of 
different  missions 

(e)  Lick  of  procedural  guidelines  for  integrating  observations 
and  ratings  across  standards  items,  missions  and  unit  echelons. 

One  of  the  major  problems  arising  in  the  T/F  outlines  concerns  forking/branching  in 
the  tasks,  standards,  and  conditions.  We  found  no  evidence  that  the  potential  lorks  within  I/I 
mission  outlines,  such  as  appears  in  Chapter  2,  Part  Two  of  the  second  volume  of  this  report, 
had  been  analysed  during  the  planning  stage  of  exercises.  Another  anomaly  became  apparent 
when  T/E  items  were  compared  between  echelons  for  three  major  missions.  Detailed  results 
and  implications  of  the  comparative  analysis  are  presented  in  Chapter  2 ol  the  second  volume. 
Briefly,  there  was  a high  degree  of  variance  in  the  intensity  with  which  behaviors  were  covered 
across  missions.  Observation  Ill.B.l  .c.  in  Table  3-1  refers  to  critical  behaviors  not  included  in 
the  T/E  outlines  which  require  anticipation  on  the  part  of  E/C  personnel. 

Another  pressing  issue  is  the  lack  of  precision  m the  specification  of  Standards.  This 
problem  as  applied  to  ground  warfare  is  most  complex.  Sec  discussion  in  Volume  2.  At  the 
present  time,  precise  and  valid  objective  numerical  standards  cannot  be  practically  applied  by 
operating  units  to  rover  the  hulk  of  mission  ditties  required  in  tactical  field  exercises.  Subjective, 
professional  judgments  will  continue  to  p!a\  a critical  role  until  the  state-of-the-art  lor  unit  stan- 
dards is  significantly  advanced.  Engagement  simulation  can  help  in  this  advance,  but  in  and  of 
itself  will  not  solve  the  standards  problem.  New  approaches  such  as  gaining  and  Delphi  methods 
should  be  explored  as  should  the  training  of  evaluators.  Follow-on  work  must,  therefore,  provide 
further  guidance  bearing  on  the  interpretation  of  T&EO  Standards. 

(3)  & (4)  Field  Observation  am  ating  Procedures.  Inadequacies  in  evaluator 
training  have  been  mentioned  repeatedly  above.  Specific  manifestations  included 

(a)  Failure  to  delineate  «//  evaluator  functions  and  train  in  these. 

(b)  Little  instruction  as  to  how  to  use  T&F  outlines  in  the  field,  and 
exercise  subjective  judgments.  Asa  result,  field  use  of  T&F  formats 
varied  widely. 

(c)  Lack  of  instructions  as  to  how  to  evaluate  performance  requiring 
coordination  between  tactical  elements  not  in  visual  contact. 

(d)  Lack  of  guidance  for  integration  of  observations  and  ratings  made 
by  different  evaluators. 

(e)  Lack  of  guidance  for  handling  field  critiques. 

(f)  Finally,  a lack  of  appreciation  of  the  complexity  and  difficulty  of 
evaluator  tasks  as  individuals,  and  as  a team. 
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Ill  practice,  E/C  personnel  have  about  five  or  six  duties,  of  which  evaluation  and  con- 
trol are  the  most  prominent.  Others  include  providing  feedback,  insuring  that  safety  rules  arc 
observed,  and  making  records  of  performance.  Typically,  little  instruction  was  provided  on  the 
use  of  T&E  outlines  in  the  field.  As  indicated  in  Table  3-1  under  Ill.C.  I .d.,  there  was  limited 
instruction  on  how  E/C  Croup  members  should  combine  dual  evaluator/controller  functions 
and  responsibilities.  Nor  did  they  receive  or  realize  the  importance  of  training  in  all  essential 
evaluator/controller  duties,  as  evidenced  by  responses  to  our  questionnaire.  Training  did  not 
normally  include  instruction  in  how  to  make  subjective  judgments  and  interpretations.  Nor 
were  evaluators  trained  in  how  to  handle  interdependent  observations  and  ratings.  We  were 
unaware  of  any  instructions  provided  evaluators  as  to  who  actually  observes  and  rates  what 
behaviors  or  events.  This  may  appear  simplistic  at  first  glance,  but  when  there  are  identical 
items  across  battalion,  company  and  platoon  mission  outlines,  this  question  arises:  Is  the 
rating  for  a battalion  simply  a summation  of  ratings  made  by  evaluators  with  platoons,  or  are 
independent  estimates  made  by  evaluators  at  company  and  battalion  levels?  We  were  unable 
to  find  guidance  on  such  questions  in  the  instructions  provided  most  E/C  Groups. 

Most  units  failed  to  conduct  E/C  Group  terrain  inspections.  Thus,  evaluator/controllers 
were  not  (well)  oriented  as  to  the  likely  How  of  events  and  how  it  may  bear  on  their  own  duties. 
As  a result,  most  evaluators  were  put  into  the  position  of  reacting  to  ongoing  events  rather  than 
anticipating  them.  Had  E/C  Group  training  included  a classroom  gaming  of  the  exercise  as  called 
for  in  Chapter  V of  ARTEP  71-2,  problems  might  have  been  obviated.  Once  the  problem  was 
underway,  only  a few  evaluators  tried  to  overcome  this  handicap  by  cueing  their  subordinates 
for  positioning  and  what  to  observe.  As  indicated  in  Table  3-1 . under  Ill.C.Z.b..  a few  trained 
evaluators  updated  instructions  to  the  evaluators  assigned  to  them,  and  provided  on-line  critiques. 
The  majority  of  E/C  Group  members  did  not  possess  continuous  communications  with  the 
OPFOR.  Clearly,  procedural  guidelines  for  adequate  communications  between  the  QPFOR  and 
E/C  Group  are  needed. 


Our  data  also  suggest  that  evaluators  need  a single  standardized  format  and  a set  of 
procedural  guidelines  for  note-taking  and  for  recording  supplementary  observations.  Recording 
behavior  varied  from  extensive  note-taking  during  the  exercise  to  no  record  keeping  at  all. 

Many  evaluators  depended  primarily  on  memory  until  breaks  between  missions,  when  they 
attempted  to  compile  permanent  data  records.  This  method  increases  the  likelihood  of  for- 
getting. If  evaluators  forget,  they  cannot  perform  their  part  in  closing  the  learning  loop.  We 
believe  that  stress  in  evaluator  school  on  observing/recording  performance  when  it  occurs,  plus 
improved  formatting  of  T&E  outlines  would  result  in  more  comprehensive  and  more  valid  descrip- 
tions of  field  performance.  Titus,  capabilities  for  training  diagnosis  would  be  much  improved. 

Finally,  E/C  personnel  were  uncertain  about  how  and  when  to  make  actual  rating 
entries  in  the  T&EOs.  They  were  also  unclear  about  how  and  when  to  integrate  field  observa- 
tions and  ratings  with  other  E/C  Group  members.  Some  evaluators  formulated  and  recorded 
S/U  ratings  immediately,  while  others  waited  until  the  end  of  particular  tasks  or  missions  to 
do  so.  Many  evaluators  attempted  to  formulate  ratings  independently,  even  where  coordina- 
tion with  other  E/C  was  necessary.  There  was  the  same  degree  of  variability  in  procedures 
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for  communicating  ratings  and  other  data  to  the  performing  units,  t ew  evaluators  routinely 
conducted  on-line  critiques  at  the  completion  of  each  problem  or  mission.  Others  did  little 
or  nothing  more  than  simply  hand  over  copies  of  their  completed  T&EO  forms  to  unit  com- 
manders. One  evaluator  went  one  step  further  than  most  of  his  counterparts  during  Division  C’s 
exercise.  When  his  platoon  was  relatively  inactive,  he  set  up  hypothetical  situations  for  all  to 
discuss.  Exercises  observed  provided  many  opportunities  for  this  type  of  “on-iine”  training 

d.  Results  Formulation,  Communication  and  Use 

(1)  & (2)  Results  Formulation  and  Communication.  There  were  deficiencies  in 
formulating  and  communicating  evaluation  results.  Among  these  were: 

(a)  Lack  of  realistic  provision  for  post-exercise  verbal  critiques  at  all 
appropriate  unit  levels. 

(b)  In  some  cases,  inadequate  provision  for  bringing  the  entire  E/C 
Group  together  after  the  exercise  for  the  purpose  of  coordinating 
observations  and  integrating  ratings. 

(c)  Lack  of  systematic  provision  in  the  LOI  for  timely  and  valid  feedback 
at  the  troop  level  administered  between  missions  during  the  exercise. 

(d)  Lack  ol  sufficient  detail  and  precision  in  the  “formaT’/written  evalu- 
ation reports  to  pinpoint  important  performance  deficiencies  requiring 
remedial  training. 

(e)  Uncertainty  regarding  the  correct  form,  content,  audiences  and  timing 
of  the  Formal  Report(s). 

(0  No  attention  to  using  alternative  media  to  enhance  the  feedback 
process  (e.g..  graphics  or  electronic  technologies). 

As  indicated  previously  under  Issue  Area  a.(2)(e),  a variety  of  feedback  forms  were 
observed  in  the  field.  Some  of  these  entailed  unplanned  training  activities  such  as  task/ 
mission  repetitions.  This  issue  area  addresses  deficiencies  in  three  types  of  feedback  and  critique 
activities:  on-line  verbal  critiques  conducted  during  the  exercise;  post-exercise  verbal  critiques; 
and  the  written  formal  evaluation  reports. 

The  Evaluation  Plans  which  were  distributed  by  sampled  field  units  were  closely 
inspected.  They  indicated  a clear  need  for  more  guidance  on  procedures  for  administering 
on-line  and  post-exercise  critiques.  Such  questions  as  whether,  how  and  when  to  intervene 
and  provide  feedback  during  the  conduct  of  a mission  were  not  addressed  in  published  evalua- 
tion plans  provided  us.  Feedback,  when  provided,  tended  to  be  fragmentary.  We  observed  no 
direct  critiques  conducted  for  unit  enlisted  personnel  except  in  the  case  of  Division  C\  Reported- 
ly in  Division  C some  evaluators  attempted  to  informally  critique  their  units  following  the  field 
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exercise.  Division  C was  the  only  sampled  unit  to  provide  written  guidance  with  respect  to  who 
was  to  attend  a post-exercise  verbal  critique  Here,  better  ways  must  be  found  to  analyse  errors 
objectively,  while  maintaining  respect  lor  commanders,  and  for  the  authority  structure. 


A coordination  meeting  for  integration  of  observations  and  ratings  was  held  by  two 
divisions,  we  were  unable  to  establish  whether  it  was  held  by  other  divisions.  There  appeared 
to  be  a lack  of  uniformity  across  divisions  as  to  who  was  to  attend. 

With  the  exception  of  Division  D,  the  formal  written  evaluation  reports  were  inade- 
quately detailed  for  diagnostic  purposes.  Division  D was  the  only  unit  which  made  a consci- 
entious effort  to  pinpoint  weaknesses.  In  a follow-up  phone  interview  with  the  G-3  of  one 
division,  we  were  informed  that  the  division  had  substituted  for  S/U  ratings  detailed  notations 
of  strengths  and  weaknesses.  They  had  formerly  used  S/U  ratings  but  believed  this  change  will 
relax  the  apprehension  observed  among  evaluated  battalion  commanders. 

Guidance  provided  with  respect  to  the  form,  content,  audiences  and  timing  of 
formal  written  evaluation  reports  varied  between  cases.  One  division  appended  a sample  evalu- 
ation report  format  to  their  Evaluation  Plan  and  emphasized  the  diagnostic  utility  of  the  results. 
One  division  provided  detailed  exemplars  of  battalion  and  company-written  evaluation  reports 
in  their  published  Evaluation  Plan. 

From  these  observations  it  is  apparent  that  field  units  need  more  systematic  guidance 
on  how  and  when  to  formulate  and  communicate  feedback,  and  to  whom. 

(3)  Use  of  Results.  The  research  team  had  but  very  limited  opportunity  to  observe 
use  of  evaluation  results.  Therefore,  we  attempted  to  determine  by  phone  and  correspondence 
whether  and  how  results  were  being  used  tor  remedial  training.  Several  types  of  major  incon- 
sistencies with  ARTEP  prescriptions  were  identified.  These  include: 

(a)  Lack  ol  precision  in  the  definition  of  planning,  execution  and 
monitoring  functions  for  the  multiple  headquarter/staff  echelons 
involved. 

(b)  A general  inability  to  bring  together  enough  resources  to  permit 
remedial  training  for  the  battalions  as  a whole. 

(c)  Limited  efforts  to  compensate  for  the  above  by  developing  con- 
current. multi-echelon  training  programs  which  are  keyed  to 
documented  weaknesses. 

(d)  Need  to  review  the  evaluation  process  from  the  perspective  of 
its  future  refinement. 
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Die  lack  ol  formal  specification  of  training  managers’  roles  in  the  results  use  phase  has 
already  been  touched  upon  under  the  first  issue  area  a.(l  )(d).  We  know  of  only  one  case  in  which 
the  battalion  commander  was  held  responsible  for  incorporating  his  unit’s  evaluation  results  into 
the  battalion  Planning  Calendar.  Specifically,  Division  D’s  brigade  commander  required  his  bat- 
talion commanders  to  justify  their  revised  plans  in  light  of  identified  deficiencies. 

The  second  major  problem  area  involves  the  lack  of  flexibility  to  incorporate  remedial 
training  needs  in  master  training  schedules.  This  is  an  area  requiring  further  study.  We  need  to 
determine  to  what  extent  existing  training  schedules  can  be  modified  to  use  evaluation  results 
effectively.  As  indicated  in  Table  3-1  under  IV.C.2.A.,  most  units  were  unable  to  schedule  re- 
medial field  training  tor  battalions  due  to  time  and  training  area  constraints.  We  were  informed 
that  Division  A has  recently  taken  commendable  steps  to  obviate  this  deficiency.  They  have 
revised  their  annual  training  schedule  to  enable  battalions  to  return  to  the  field  within  a month 
lollowing  an  external  evaluation.  Alternative  means  of  retraining  were  not  fully  explored  by 
most  other  units  when  it  was  impossible  to  rerun  a battalion  as  a whole  (see  IV.C.5.  in  Table 
3-1 ).  Division  B was  an  exception  to  this  general  observation.  We  were  informed  that  they 
scheduled  two  weeks  of  multi-echelon  make-up  training  such  that  tasks  already  mastered  are  de- 
emphasized  and  those  requiring  practice  are  performed.  However,  we  do  not  know  whether 
training  managers  systematically  monitored  and  critiqued  remedial  training  activities. 

Tinally.  tollow-up  phone  conversations  revealed  a complete  lack  of  effort  in  reviewing 
and/or  refining  present  evaluation  procedures.  The  majority  of  field  units  in  our  sample  did  not 
send  the  U.S.  Army  Training  Board  a copy  of  their  written  evaluation  reports.  Nor  did  they  com- 
plete the  questionnaire  which  appears  in  the  back  of  71-2.  To  our  knowledge,  only  one  unit. 
Division  B.  assigned  full-time  statt  with  the  responsibility  of  monitoring  and  refining  their  evalu- 
ation efforts,  as  indicated  under  IV.C.6.a.  in  Table  3-1. 

3-3.  SUMMARY:  REFLECTIONS 

This  chapter  reports  results  of  use  of  a case  study  method  to  collect  information  as  to  how 
tour  divisions  conduct  battalion  field  evaluations.  What  we  conceived  to  be  mistakes  and  omis- 
sions were  highlighted  to  better  identify  substantive  areas  to  be  covered  in  the  Field  Guide.  This 
emphasis  should  not  overshadow  the  tact  that  local  initiative  was  evident  as  well  more  exactly 
perhaps,  well-springs  of  local  initiative  seeking  further  ARTEP  related  direction  and  clarification. 

Let  us.  tor  the  moment,  consider  these  omissions  and  errors  as  possibly  symptomatic  of 
institutional  problems.  Institutions  have  policies,  people  and  rules  continuously  in  dynamic 
interaction.  Within  this  are  understandings  as  to  what  is  policy,  what  is  important,  what  are 
the  proper  ways  to  conduct  business.  Tilings  get  done  because  interlinked  members  of  the 
institution  share  understandings  as  to  policy,  priorities  and  practices. 
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We  suspect  that  tc  fully  implement  the  changeover  from  ATTs  to  ARTI  P some  of  today's 
understandings  must  be  changed.  And  in  these  directions: 

• Needed  at  all  levels  is  a better  appreciation  of  the  complexity  and  difficulty 
of  mounting  sizeable  field  evaluations  to  derive  best  training  value. 

• This  recognition  should  be  reflected  in  emphasis  on  establishing  and  checking 
our  E 1C  Group  roles  and  procedures,  and  in  more  and  better  evaluator  train- 
ing. [-valuators  learn  as  much,  we  believe,  as  the  leader(s)  of  unit(s)  being 
evaluated.  Basically,  however,  the  good  evaluator  is  a multiplier.  What 
people  learn  in  the  field  depends  largely  on  his  careful  observations,  and 
how  he  provides  feedback. 

• Goals  need  to  be  established  for  improving  field  evaluations  by  team  efforts 
between  TRADOC.  FORSCOM  and  units,  and  other  responsible  parties.  In 
human  learning,  breakthroughs  are  rare;  to  be  sought,  rather,  incremental  gains 
and  means  of  anchoring  them.  Here,  it  is  necessary  to  develop  measures  ol 
the  extent  to  which  goals  are  being  attained. 

These  case  studies  serve  as  input  to  the  next  two  volumes.  Volume  II  analyses  issues  anil 
problems  surfaced  and  recommends  solutions.  A variety  of  scientific  concepts  can  provide 
better  insights  into  a number  of  these  problems,  suggest  possible  solutions,  and  means  tor 
evaluation  of  solutions.  This  material  is  not  intended  to  be  unit  specific.  It  should,  therefore, 
have  broader  applications  than  the  battalion  oriented  Volume  III  Field  Guide. 


